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Abstract.  We  have  previously  proposed  a  computer  guidance  system 
for  liver  punctures  designed  for  intubated  (free  breathing)  patients.  The 
lack  of  accuracy  reported  (1  cm)  was  mostly  due  to  the  breathing  motion 
that  was  not  taken  into  account.  In  this  paper  we  modify  our  system  to 
synchronise  the  guidance  information  on  the  expiratory  phases  of  the 
patient  and  present  an  evaluation  on  6  patients  of  our  respiratory  gated 
system. 

Firstly,  we  show  how  a  specific  choice  of  patient  allows  us  to  rigorously 
and  passively  evaluate  the  system  accuracy.  Secondly,  we  demonstrate 
that  our  system  can  provide  a  guidance  information  with  an  error  below 
5  mm  during  expiratory  phases. 

1  Introduction 

CT/IRM  guided  liver  puncture  is  a  difficult  gesture  which  can  dramatically  bene¬ 
fit  from  a  computer  guidance  system  1311411015]  .  Indeed,  such  systems  can  reduce 
the  repetitive  CT /MRI  images  needed  for  needle  adjustment  and  the  reinsertion 
attempts  that  lengthen  the  intervention  duration  and  increase  radiation  expo¬ 
sure  (when  CT-guided).  Moreover,  it  can  improve  the  insertion  accuracy  that 
currently  depends  on  the  practitioner’s  experience. 

In  a  previous  work  [9],  we  have  introduced  in  the  operating  room  a  guiding 
system  for  radio-frequency  thermal  ablation  (RFA)  and  showed  that  this  system 
meets  the  sterility  and  cumbersomeness  requirements.  Then,  the  system  accu¬ 
racy  was  evaluated  on  patients  with  a  passive  protocol  neglecting  the  breathing 
influence.  The  accuracy  results  around  1  cm  were  much  larger  that  those  ob¬ 
tained  on  a  phantom  (2  mm)  [8](Wacker  et.  al.  obtained  an  equivalent  result 
on  a  freely  breathing  pig  M)-  Indeed,  liver  displacement  reaches  1  cm  during 
shallow  breathing  mm- 

A  recent  report  shows  that  RFA  ablation  has  to  be  performed  on  tumors 
which  diameter  is  between  1  and  3  cm  m-  Thus,  our  radiologists  consider  that 
a  guidance  system  has  to  provide  an  accuracy  above  5  mm  to  avoid  destroying 
too  much  healthy  cells  when  the  needle  tip  is  not  perfectly  centered  in  the 
tumor.  Consequently,  to  provide  useful  guidance  information  to  the  practitioner, 
we  cannot  neglect  the  breathing  deformations.  Several  approaches  are  possible 
to  take  the  breathing  into  account.  Firstly,  we  can  use  the  predictive  model  of 
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organ  positions  with  respect  to  the  breathing  proposed  by  [1] .  Unfortunately,  it  is 
not  accurate  enough  for  our  application  (error  of  prediction  above  5  mm  for  the 
liver).  Secondly  we  can  synchronize  the  guidance  system  on  a  particular  point  of 
the  breathing  cycle  i.e.  the  preoperative  image  and  the  guidance  information  are 
respectively  acquired  and  provided  at  the  same  point  of  the  respiratory  cycle. 
This  approach  is  motivated  by  several  studies  that  evaluate  the  repositioning 
error  of  the  liver  between  1  and  2  mm  |1I16I2I12I15].  Therefore,  the  cumulated 
error  of  the  system  components  (~  3  mm)  and  the  repositioning  error  (~  2  mm) 
should  remain  below  5  mm. 

This  reasonable  assumption  has  still  not  been  demonstrated  neither  on  an¬ 
imals  nor  patients:  validation  has  been  only  performed  on  cadavers  [3]  or  on 
living  pigs  without  taking  breathing  into  account  m-  In  this  paper,  we  report 
an  in  vivo  accuracy  evaluation  of  our  system  with  a  respiratory  gating  tech¬ 
nique.  After  a  presentation  of  the  system  principles,  we  explain  how  the  choice 
of  specific  patients  allows  us  to  develop  a  riskless  protocol  to  evaluate  rigorously 
the  system  accuracy.  Finally,  we  present  the  experimental  results  obtained  on  6 
patients  and  demonstrate  that  the  system  accuracy  fits  the  clinical  requirements 
when  the  guidance  information  is  provided  during  expiratory  phases. 

2  System  Components 

In  our  setup,  two  jointly  calibrated  cameras  are  viewing  the  patient  lying  on 
the  CT-table  who  is  under  general  anesthesia  and  ventilated  (70%  of  RFA  are 
performed  under  general  anesthesia  in  our  local  hospital).  Radio-opaque  markers 
with  a  ring  shape  are  stuck  on  his  abdominal  skin  and  a  black  dot  is  printed 
inside  each  marker.  Then,  a  preoperative  CT  acquisition  is  performed  during 
an  expiratory  phase,  the  markers  are  removed  and  a  3D  model  of  the  patient 
(including  his  skin,  liver,  tumors  and  markers)  is  automatically  obtained  from  the 
CT  image  (cf.  top  left  Fig.  [T])  jTUj .  Then,  this  patient  model  is  rigidly  registered 
in  the  camera  frame  using  radio-opaque  markers,  their  position  being  extracted 
in  both  CT  and  video  images.  The  marker  extraction  and  matching  is  performed 
automatically  and  the  registration  is  performed  by  minimisation  of  the  Extended 
Projective  Point  Criterion  (EPPC)  (algorithmic  details  are  further  explained 
and  validated  in  m )•  The  needle  position  is  also  tracked  in  real-time  by  the 
cameras  so  that  we  can  display  on  a  screen  its  relative  position  with  respect 
to  the  patient  model  to  guide  the  practitioner  (cf.  right  Fig.  [T]).  The  guidance 
information  is  provided  only  during  the  expiratory  phases.  These  phases  are 
automatically  detected  by  the  system  using  the  reprojection  error  of  CT  markers 
in  the  video  images.  Indeed,  this  error  computed  in  real-time  is  roughly  sinusoidal 
and  minimal  during  the  expiration. 

We  remind  here  the  four  error  sources  when  the  system  is  used  by  the  prac¬ 
titioner.  Three  of  them  are  due  to  the  system  only:  needle  tracking,  patient 
registration  and  organ  repositioning.  The  last  error  source  is  the  ability  of  the 
practitioner  to  follow  the  guiding  information  provided  by  the  system  (we  call 
it  guidance  error). 
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Fig.  1.  Illustration  of  the  system  principles 

3  A  Safe  Evaluation  Protocol  with  Specific  Patients 

Hepatic  tumors  sometimes  need  contrast  agent  to  be  injected  in  the  patient 
to  be  visible  in  the  CT  modality.  For  these  patients,  the  clinical  protocol  to 
target  tumors  in  interventional  CT  is  slightly  different  from  the  standard  one.  A 
preoperative  CT  acquisition  of  the  abdomen  is  realized  with  contrast  agent.  To 
guide  the  needle,  the  practitioner  performs  a  mental  registration  of  interventional 
CT  slices  with  the  preoperative  CT  image  (in  which  tumors  are  visible).  When  he 
thinks  the  needle  is  correctly  positioned,  a  second  CT  acquisition  with  contrast 
agent  of  the  patient  abdomen  is  performed.  This  second  CT  acquisition  allows  the 
practitioner  to  check  the  needle  position  with  respect  to  the  tumor  he  targeted. 

The  additional  images  available  for  these  patients  allow  us  to  perform  a  passive 
evaluation  of  our  system  using  the  following  data  acquisition  protocol: 

Experimental  protocol 

Firstly,  we  stick  homogeneously  radio-opaque  markers  on  the  patient  abdomen 
and  a  black  dot  is  printed  inside  them.  Then,  a  preoperative  acquisition  CT1  is 
realized  in  full  expiration  (it  includes  all  the  markers  and  the  liver).  The  practi¬ 
tioner  removes  the  markers  and  attaches  to  the  needle  a  sterile  pattern  that  allows 
its  tracking.  Then,  he  inserts  the  needle  until  he  thinks  he  has  correctly  targeted 
the  tumor.  After  the  needle  positioning,  a  stereoscopic  video  of  the  patient  ab¬ 
domen  and  needle  is  done  during  several  breathing  cycles.  Finally,  a  second  CT 
acquisition  CT2  is  done  in  full  expiration,  the  needle  remaining  inside  the  patient 
(CT2  also  includes  the  whole  liver).  This  protocol  does  not  change  the  informa¬ 
tion  used  by  the  practitioner  to  guide  the  needle:  he  realizes  the  intervention  with 
his  usual  means  (CT-slices)  without  any  advice  nor  instruction  from  our  system. 

From  the  acquired  experimental  data,  we  can  not  only  evaluate  the  system  accu¬ 
racy  but  also  check  that  the  needle  remains  straight  during  the  insertion  and  that 
the  repositioning  error  of  abdominal  structures  at  expiratory  phases  is  negligible. 
To  perform  these  three  studies,  we  realize  the  three  following  evaluation  processes: 

Evaluation  of  the  liver  repositioning  error  (cf.  Fig.  [5]) 

We  extract  the  spine,  liver  and  skin  in  both  CT1  and  CT2.  Then,  the  spine  from 
CT2  is  rigidly  registered  on  the  spine  in  CT1  with  the  Iterative  Closest  Point 
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algorithm  and  the  computed  transformation  is  applied  to  liver  and  skin  from 
CT2.  This  registration  allows  us  to  compare  the  relative  movement  of  liver  and 
skin  with  respect  to  a  common  rigid  structure.  To  quantify  these  movements, 
we  compute  the  distance  between  the  liver  (resp.  skin)  surface  in  CT1  with  the 
liver  (resp.  skin)  surface  extracted  from  CT2  and  registered  in  CT1. 


Fig.  2.  To  evaluate  the  repositioning  error  of  liver  and  skin  we  firstly  register  the  spines 
from  CT1  and  CT2.  Then  we  apply  the  found  rigid  transformation  to  liver  and  skin 
surfaces  and  measure  the  distance  between  both  surfaces. 

Evaluation  of  the  needle  curvature  (Fig.  [3]) 

The  needle  in  CT2  is  extracted  and  we  estimate 
orientations  of  the  first  and  second  half  of  its 
length.  Then,  we  compare  both  orientations  us¬ 
ing  the  angular  deviation  a  and  the  needle  de¬ 
flection. 

Evaluation  of  the  system  accuracy  (cf.  Fig.  0} 

Liver  and  needle  surfaces  are  extracted  from  CT2.  The  liver  surface  in  CT2  is 
rigidly  registered  (using  ICP)  on  the  liver  surface  in  CT1  and  the  computed 
transformation  is  applied  to  the  needle  extracted  in  CT2.  This  registration  pro¬ 
vides  the  final  needle  position  in  the  CT1  image.  Then,  we  register  the  patient 
model  from  CT1  (with  the  needle)  in  the  camera  reference  frame  using  the  video 
image  of  the  patient  at  full  expiration.  Finally,  we  evaluate  the  euclidean  dis¬ 
tance  between  the  needle  tip  tracked  by  the  camera  (at  expiration  phase)  and 
the  needle  tip  in  CT1  registered  in  the  camera  frame. 

We  call  this  distance  system  accuracy  and  emphasize  it  is  an  evaluation  of 
the  cumulated  errors  of  the  needle  tracking,  the  patient  model  registration  and 
the  organ  repositioning.  It  does  not  include  the  guidance  error  (defined  in  Sec. 
2).  Consequently,  our  experimental  protocol  allows  us  to  evaluate  all  the  error 
sources  that  only  depend  on  the  system  and  not  on  practitioner  ability  0.  Alter¬ 
natively,  the  measured  error  corresponds  to  the  final  system  error  if  the  needle 
insertion  is  robotized  (in  that  case  the  guidance  error  is  negligible). 

1  In  fact,  we  measure  a  slight  over-estimation  of  the  system  error:  the  needle  registra¬ 
tion  from  CT2  to  CT1  is  not  perfect  (we  check  its  high  accuracy  in  Sec.  4). 


Fig.  3.  Evaluation  of  the  needle 
curvature 
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Fig.  4.  Illustration  of  the  passive  protocol  to  evaluate  the  system  accuracy 

4  Evaluation  of  the  System  on  Six  Clinical  Cases 

Six  patients  (5  males  and  1  female,  age  between  50  and  60)  have  participated 
in  our  experiments  (they  signed  an  agreement  form).  They  all  had  tumors  the 
diagnosis  of  which  led  to  a  RF  thermal  ablation.  Resolution  of  CT  images  was  1  x 
1x2  mm3.  Below  are  presented  the  results  obtained  for  the  three  experimental 
evaluations  described  in  the  previous  section. 

Verification  of  the  needle  rigidity  assumption.  One 

can  see  in  Tab.  Q]that  the  needle  deflection  is  not  negligible 
in  30%  of  cases  as  it  can  reach  2.5  mm.  Since  the  system 
assumes  that  the  needle  remains  straight,  the  needle  tip 
position  provided  by  the  system  is  systematically  biased 
when  there  is  an  important  deflection.  Visual  illustrations 
of  a  deflection  are  provided  on  Fig.  0 

We  are  aware  the  practitioner  sometimes  bends  the  nee¬ 
dle  on  purpose  to  avoid  a  critical  structure.  For  all  the 
reported  cases,  the  practitioner  estimated  that  this  was 
not  the  case.  Consequently,  we  have  measured  here  the 
uncontrollable  bending  of  the  needle. 

Table  1.  Left  table:  Evaluation  of  the  needle  curvature  after  its  positioning  in  the 
patient.  Right  table:  Distance  between  the  registered  surfaces  of  spine,  liver  and  skin. 


Fig.  5.  Lateral  and 
axial  views  of  the 
needle  (patient  2) 


d(Si,S2)  in  mm 

Spine 

Liver 

Skin 

Patient  1 

0.8 

1.5 

1.6 

Patient  2 

0.8 

1.2 

1.8 

Patient  3 

0.9 

1.4 

1.9 

Patient  4 

1.1 

1.5 

3.2 

Patient  5 

0.9 

1.7 

1.8 

Patient  6 

1.2 

1.82 

1.7 

Average 

0.95 

1.6 

2.0 

angular  deviation 
alpha  (°) 

needle 

deflection  (mm) 

Patient  1 

1.0 

0.85 

Patient  2 

2.8 

2.5 

Patient  3 

0.5 

0.4 

Patient  4 

0.6 

0.5 

Patient  5 

1.1 

1.0 

Patient  6 

1.8 

1.82 
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Evaluation  of  the  organ  repositioning  error.  To  quantify  the  distance  be¬ 
tween  two  registered  surfaces  Si  and  S2,  we  compute  the  average  of  the  distance 
between  each  point  on  Si  to  the  surface  Sj : 


d(S1,S2) 


EMi£Si  +  EPies2  d(Pi,  SQ2 

2  •  ( card(S\ ) 


where  the  distance  d(Mi,  S)  between  a  point  M,  and  a  surface  S  is  interpolated 
from  the  3  closest  points  of  M%  belonging  to  S. 

One  can  see  in  Tab.  [T]  (right)  that  the  distance  between  liver  surfaces  is  within 
2  mm  for  each  patient  which  is  of  the  same  magnitude  as  the  segmentation  uncer¬ 
tainty.  To  check  that  the  measured  distances  are  not  due  to  a  pure  translation,  we 
display  the  relative  position  of  both  surfaces.  Fig.  E]  (left  columns)  shows  clearly 
that  surfaces  are  closely  interlaced  for  all  patients.  This  means  that  the  observed 
distance  is  essentially  due  to  the  segmentation  error  in  the  CT  acquisitions  and 
that  the  repositioning  error  of  the  liver  is  about  1  mm. 


Fig.  6.  Visual  check  of  liver  and  skin  repositioning  errors  on  3  patients  (resp.  left  and 
right  columns)  .  Two  opposite  views  of  registered  surfaces  are  provided  for  each  patient. 

Oddly,  distances  between  skin  surfaces  are  not  very  low  for  each  patient.  A 
visual  check  (see  right  columns  in  Fig.  [6])  of  registered  surfaces  shows  that  for 
these  patients  the  skin  of  the  lower  part  of  the  abdomen  has  moved  between  the 
two  CT  acquisitions.  An  inspection  of  both  CT  indicates  that  a  gas  movement 
in  the  stomach  and  bowels  was  responsible  for  this  deformation.  We  highlight 
that  this  skin  deformation  highly  disturbs  the  system  if  we  take  the  radio-opaque 
markers  on  the  deformed  zone  into  account  to  compute  the  patient  model  regis¬ 
tration.  Indeed,  the  system  implicitly  assumes  that  the  relative  position  of  the 
liver  w.r.t.  the  markers  remains  rigid  during  the  intervention.  Consequently,  the 
skin  deformation  can  lead  to  a  wrong  estimation  of  the  liver  position. 
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We  notice  that  this  phenomenon  of  gas  movement  essentially  happened  when 
the  practitioner  used  the  US  probe.  This  means  that  the  system  should  be  care¬ 
fully  used  if  a  US  probe  is  manipulated.  To  avoid  this  problem,  we  can  position 
the  radio-opaque  markers  on  the  upper  part  of  the  abdomen  only,  which  is  a  zone 
not  influenced  by  gas  movements.  In  the  following  we  did  not  use  radio-opaque 
markers  on  a  deformed  zone  to  evaluate  the  system  accuracy. 

Influence  of  breathing  on  the  system  accuracy.  During  the  6  interven¬ 
tions,  the  needle  and  the  patient  were  video  tracked  along  several  breathing 
cycles.  In  Tab.  0  one  can  read  for  each  patient  the  system  accuracy,  the  3D/2D 
reprojection  error  of  CT  markers  in  the  video  images  and  the  3D/3D  registration 
error  between  CT  markers  and  markers  reconstructed  from  video  images.  These 
values  were  averaged  on  expiratory  phases  that  were  video  recorded.  Addition¬ 
ally,  we  report  in  Fig.  [7]  a  sample  for  patients  1  and  2  during  4  breathing  cycles 
of  the  system  accuracy,  the  3D/2D  and  the  3D/3D  registration  errors. 


\ 

-Aw 

£ 

0 

Piratory  pi 

n 

— ^SSsSSr 

/Oi 

Fig.  7.  Sample  of  system  accuracy  and  registration  errors  reported  during  several 
breathing  cycles  with  patients  1  and  2 


Results  in  Tab.  ^indicate  clearly  that  for  all  patients  the  system  accuracy  dur¬ 
ing  expiratory  phases  is  between  4  and  5  mm.  The  two  worst  results  have  been 
obtained  for  patients  whose  abdominal  zone  has  been  deformed  between  the  pre¬ 
operative  and  control  CT  acquisitions.  Indeed,  in  those  cases,  less  markers  could 
be  used  to  compute  the  patient  model  registration.  Note  that  including  markers 
that  had  moved  between  the  CT  acquisitions  in  the  registration  computation 
leads  to  much  worse  accuracy  (above  1  cm). 

For  patients  whose  needle  was  bent,  we  have  evaluated  the  system  accuracy 
after  having  taken  the  observed  curvature  into  account.  This  showed  that  if  the 
rigidity  assumption  of  the  needle  was  true  the  system  accuracy  would  be  slightly 
better  (about  0.5  mm). 

One  can  see  in  FigJ7]that  RMS  errors  evolve  cyclically,  as  expected,  and  are 
always  minimal  in  expiration  phases.  The  system  accuracy  also  evolves  cyclically 
but  is  not  always  minimal  in  expiration  phases.  Indeed,  since  the  patient  model 
registration  is  not  perfect,  the  system  can  register  the  needle  extracted  from  the 
CT  at  a  position  that  corresponds  to  an  intermediate  phase  of  the  breathing 
cycle  (whereas  it  should  be  registered  at  expiratory  position). 
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Table  2.  Average  for  each  patient  of  the  system  error,  3D/2D  and  3D/3D  registration 
errors  during  expiration  phases.  The  system  provides  an  average  guiding  information 
during  expiratory  phases  with  an  accuracy  below  5  mm.  Values  in  brackets  correspond 
to  the  results  obtained  when  the  markers  on  an  abdominal  zone  deformed  by  gas  motion 
are  used  for  the  patient  model  registration.  Values  in  square  brackets  correspond  to  the 
system  accuracy  re-evaluated  after  a  compensation  of  the  important  needle  curvature 
(only  for  patients  2  and  6). 


Number  of 
markers  used 

RMS  3D/2D 
(pixel) 

RMS  3D/3D 
(mm) 

System 

accuracy  (mm) 

Patient  1 

15 

1.3 

1.5 

4.0 

Patient  2 

13 

1.0 

1.7 

4.2  [3.5] 

Patient  3 

6(15) 

1.2  (2.2) 

1.4  (2.5) 

5.2  (14.5) 

Patient  4 

12 

1.5 

1.2 

4.1 

Patient  5 

8(13) 

0.9  (2.0) 

1.5  (2.4) 

4.8  (12.3) 

Patient  6 

14 

1.2 

1.2 

4.3  [3.9] 

Average 

11.5 

1.18 

1.44 

4.3 

5  Conclusion 

We  have  developed  a  computer  system  to  guide  liver  percutaneous  punctures 
in  interventional  radiology.  To  tackle  the  breathing  motion  issue  that  induces 
a  movement  of  the  liver  (above  1  cm),  we  propose  to  use  a  respiratory  gating 
technique.  We  synchronize  the  preoperative  CT  acquisition  and  the  guidance 
step  with  the  expiratory  phases  of  the  patient.  Then,  we  assume  pseudo  static 
conditions  and  rigidly  register  the  patient  model. 

To  assess  rigorously  the  system  accuracy  and  the  pseudo  static  assumption 
on  real  patients,  we  propose  a  passive  protocol  on  carefully  chosen  patients 
that  allows  us  to  obtain  a  ground  truth  CT  at  the  end  of  the  needle  insertion. 
Experimental  results  show  firstly  that  the  liver  repositioning  error  is  about  1 
mm  whereas  it  is  sometimes  much  more  important  for  the  skin  because  of  gas 
movement  in  the  bowels.  This  phenomenon  can  dramatically  decrease  the  system 
accuracy  if  markers  on  the  deformed  zone  are  used  to  compute  the  patient  model 
registration.  Therefore,  to  avoid  this  problem,  markers  have  to  be  positioned  only 
around  the  ribs.  Secondly,  we  have  evaluated  that  the  needle  curvature  can  cause 
a  needle  tracking  error  above  2  mm  (although  the  practitioner  thought  it  was 
not  bent).  Despite  these  uncertainties,  we  have  finally  showed  that  our  system 
accuracy  during  the  patient  expiratory  phases  is  about  4.5  mm,  which  fits  the 
medical  requirements. 

We  investigate  now  the  integration  of  an  electromagnetic  tracker  in  the  current 
system  so  that  we  will  be  able  to  directly  track  the  needle  tip  (although  this  is 
still  a  challenge  due  to  ferromagnetic  object  presence  in  the  operating  room). 
Last  but  not  least,  a  validation  step  including  the  needle  manipulation  by  the 
practitioner  is  planned  for  next  year. 
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